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Abstract: Differential Evolution (DE) is a powerful yet simple 
evolutionary algorithm for optimization of real valued, multi 
modal functions. DE is generally considered as a reliable, 
accurate and robust optimization technique. However, the 
algorithm suffers from premature convergence, slow 
convergence rate and large computational time for optimizing 
the computationally expensive objective functions. Therefore, 
an attempt to speed up DE is considered necessary. This paper 
introduces an improved differential evolution (IDE), a 
modification to DE that enhances the convergence rate without 
compromising with the solution quality. In improved 
differential evolution (IDE) algorithm, initial population of 
individual is partitioned into several sub-populations, and then 
DE algorithm which utilize only one set of population instead 
of two as in original DE, is applied to each sub-population 
independently. At periodic stages in evolution, the entire 
population is shuffled, and then points are reassigned to sub- 
populations. The performance of IDE on a test bed of functions 
is compared with original DE. It is found that IDE requires 
less computational effort to locate global optimal solution. 

Keywords: Differential evolution, shuffled complex evolution, 
optimization. 

I.Introduction 

DE was proposed by Storn and Price [1 ] in 1995. It soon 
became a popular tool for solving global optimization 
problems because of several attractive features like having 
fewer control parameters, ease in programming, efficiency 
etc. DE is similar to GAs in the sense that it uses same 
evolutionary operators like mutation, crossover and selection 
for guiding the population towards the optimum solution. 
Nevertheless, it's the application of these operators, explained 
in Section II that makes DE different from GA. DE has been 
successfully applied to solve a wide range of real life 
application problems [2 - 3] and has reportedly outperformed 
other optimization techniques [4 -6] . Despite several positive 
features, it has been observed that DE sometimes does not 
perform as good as the expectations. Empirical analysis of 
DE has shown that it may stop proceeding towards a global 
optimum even though the population has not converged to a 
local optimum [7]. The situation when the algorithm does not 
show any improvement though it accepts new individuals in 
the population is known as stagnation. Besides this, DE also 
suffers from the problem of premature convergence due to 
loss of diversity in the population. The entire population 
converges to a point which may not even be a local optimal 
solution. It generally takes place when the objective function 
is multimodal having several local and global optima. Like 
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other EA, the performance of DE deteriorates with the increase 
in dimensionality of the objective function. Several 
modifications have been made in the structure of DE to 
improve its performance [8 - 10]. In the present study we 
propose two modifications in the basic scheme of DE. The 
first modification is the concept of dividing the population 
into different subpopulations and the second modification is 
to use a single array in DE in contrast with the two arrays 
used in basic DE proposed by Storn and Price. The remaining 
of the paper is organised as follows; in Section 2, we give a 
brief description of DE. In Section 3, we describe the proposed 
DE versions. In Section 4, experimental settings and numerical 
results are given. The paper concludes with section 5. 

H. Basic DE 

As mentioned earlier in the previous section, there are 
several variants of the DE-algorithm [11]. Throughout the 
present study we shall follow the version DE/ rand/ 1 /bin, 
which is apparently the most commonly used version and 
shall refer to it as basic version. This particular scheme may 
be described as: DE starts with a population of NP candidate 
solutions which may be represented as X , i = 1, . . . ,NP, 
where index i denotes the population and G denotes the 
generation to which the population belongs. The working of 
DE depends on the manipulation and efficiency of three main 
operators; mutation, reproduction and selection. 

Mutation:. The mutation operation of DE applies the 
vector differentials between the existing population members 
for determining both the degree and direction of perturbation 
applied to the individual subject of the mutation operation. 
The mutation process at each generation begins by randomly 
selecting three individuals in the population. The i ,h perturbed 
individual, V. _ ,, is then generated based on the three chosen 

I,U+ 1 <J 

individuals as follows: 

(X„ r ,"X, n ) (1) 

{ 1, . . . , NP) are randomly 
* i, F [0, 1+],F is the control 
parameter. 

Crossover. The perturbed individual, V.„ x = (v 1G+I , . . • , 
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j=l...n, ke{l,...,n) is a random parameter's index, chosen 
once for each i, and the crossover rate, Cr e [0, 1], is set by 
the user. 

Selection: The population for the next generation is selected 
from the individual in current population and its 
corresponding trial vector according to the following rule 



U lG+l iff(U ia+l )<f(X iG ) 
X :r , otherwise 



(3) 



Each individual of the temporary (trial) population is compared 
with its counterpart in the current population. The one with 
the lower objective function value will survive from the 
tournament selection to the population of the next generation. 
As a result, all the individuals of the next generation are as 
good as or better than their counterparts in the current 
generation. In DE trial vector is not compared against all the 
individuals in the current generation, but only against one 
individual, its counterpart, in the current generation. 

III. Improved differential evolution 

In the proposed work we have done two modifications (i) 
concept of shuffled complex evolution (SCE) [12] and (ii) DE 
using one set of individuals instead of two as in original DE, 
throughout of this paper we will call it DEI . The characteristics 
of SCE and principle of DEI [13] are briefly explained. The 
concept of the SCE approach is to treat the global search as 
a process of natural evolution. The sampled points (NP in 
number) constitute a population which is partitioned into 
several complexes, each of which is permitted to evolve 
independently (i.e., search the space in different directions). 
After a certain number of generations, the complexes are 
forced to mix, to form new complexes through a process of 
shuffling. This procedure enhances survivability by sharing 
of information (about the search space) gained independently 
by each complex. Each member of a complex is a potential 
parent which can participate in the process of reproduction. 
To ensure that the evolution process is competitive, we 
require that the probability that better parents contribute to 
the generation of offspring is higher than that of worse 
parents. Finally, each new offspring replaces the worst point 
of the current complex rather than the worst point of the 
entire population. This ensures that every parent gets at least 
one chance to contribute to the reproduction process before 
being replaced or discarded. Thus, none of the information 
contained in the sample is ignored. The major difference 
between DE and DEI is that DEI maintains only one set of 
individuals. The set of individuals is updated as and when a 
better solution is found. Also, these newly found better 
solutions can take part in mutation and crossover operation 
in the current generation itself as opposed to DE (where 
another array is maintained and these better solutions take 
part in mutation and crossover operations in next generation). 
Updating the single set continuously enhances the 
convergence speed leading to less function evaluations as 
compared to DE which maintains two sets consuming extra 
memory and CPU-time (more function evaluations). This 
modification enables the algorithm to get a better trade off 
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between the convergence rate and robustness. In IDE, the 
two concepts described above are merged together to form a 
new variant of DE. A population of individuals sampled 
randomly from the feasible space using uniform probability 
distribution. Then the population is sorted in increasing order 
of function values and partitioned in to several sub 
populations. Each sub population independently executes 
DEI. At periodic stage in the evolution, the sub population 
are forced to mix and points are reassigned to ensure 
information sharing. The working procedure of the algorithm 
is outlined below: 

Step 1: Initialize the population set S uniformly. 
Step 2: Sort the population set S in ascending order. 
Step 3: Partition S into/? sub populations S', S 2 , ....,S P , each 
containing m points, such that: 

s* ={^,f! -^ =x kw f J =/ w ,j -w* k=i,.., P . 

Step4: Apply DEI to each sub population S k to maximum 
number of generation G . 

^ max 

Step5: Replace sub populations S', S 2 , ....,S P into S and check 
whether the termination criterion met if yes then stop 
otherwise go to step 2. 

IV. Experimental settings and results 

Based on the mechanism described in previous section, 
we propose four schemes based of the number of sub 
populations and the number of times DE is invoked in each 
sub population. Since the basic version of DE requires at 
least 4 points, the population size of the proposed algorithm 
should be a multiple of 4 so that each sub population has 
minimum number of required points. The proposed schemes 
are compared to the original DE in terms of average fitness 
function value, standard deviation, number of function 
evaluations and time taken. Experimental settings are 
population size NP=10*n,F=0.5,C =0.5, Maximum NFE=10 6 , 
number of times DEI called (N DE ) =NP/2 &NP/4 and accuracy 

io- 4 . 

Numerical results: 

The algorithms are compared in terms of average best 
fitness function value, standard deviation, average number 
of function evaluations and average time taken (in sec) 
obtained after 30 runs. The numerical results are given in 
Table 1 . When the algorithms are compared according to the 
average fitness function value, we can see that all the 
proposed schemes performed at par with the original DE and 
in some cases even gave better results. The finer performance 
of the proposed versions is more evident when we compare 
the average number of function evaluations and the time 
taken by the algorithms to meet the stopping criteria, where 
in almost all the test cases, the proposed versions converged 
faster than the original DE. However, none of the algorithms 
converged for the Schwefel function. All problems are tested 
for dimension 50 and taken from the literature [14]. 
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Table 1 : Comparison of average fitness function value, standard deviation number of functions evaluations and time 



TAKEN IN SECONDS FOR ALL ALGORITHMS 



Fun 




Fibres s (FF), Standard deviation [STD), ^itii : Tim? in sk 


DE 


IDE1 
P = 2. Nra=2n 


IDES 

P = 2. Ndi=h 


IDE 3 
p = 4. Nra=2n 


IDE4 
P = 4. NDi=n 


facx. 


FF 
STD 
NFE 
Tim* 


0.00025917E 

0.000210415 

916500 

112 


0.000122B11 

0.000111969 

900500 

103.0 


0.0001753B4 
00016112 

875500 
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0000121501 

0.000128962 
B 50 500 
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9B.00 


Je^ 
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NFE 
Tim? 


0.99992B 

2.40074e-005 

390500 
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1.00B33e-005 
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(7.77316e-006) 
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(40.00) 
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(6. B062S?- 006) 375500 

(40.00) 


few 


FF 
STD 
NFE 
Tim? 


B.4B06U-005 

(7.90575e-OO6) 

762 BOO 

(96.60) 


3.47053e-005 

(2.9B511e-005) 

750500 

(89.00) 


7.686O6?-O05 

(1.7921Be-005) 

725500 

(85.00) 
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(10B.0) 


2\6:"6"63?-005 

(2.00426e-005) 

500500 

(10B.0) 


4.5i9U^dd5 

(6.15258e-006) 
475500 
(101.6) 


4.617BBe-00i 

(4.34424e-005) 

450500 

(96.00) 


j.6E"U-0a5 
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V. Conclusions 

In the proposed study we suggested four versions of DE 
based on population partitioning and using a single array DE 
in place of 2 array original DE. The proposed versions are 
tested on a set of 5 benchmark problems taken from literature. 
From the numerical results we can see that the proposed 
schemes help in improving the solution quality as well as the 
convergence rate in most of the test cases. The concept of 
partitioning the population and shuffling the candidates help 
in maintaining the diversity of the population and the concept 
of using a single array DE help in faster convergence. In 
future we plan to apply the proposed schemes on a more 
comprehensive set of test problems. Also we plan to compare 
the proposed versions with other models of DE. 
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